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first,  second,  and  third  order  sequential  input  adaptive  systems  is  presented.  In 
these  systems,  a  theoretical  controller  predicts  the  input  at  instants  by  n  terms 
of  a  Taylor  series  representation  of  the  input  and  effect  open-loop  control  over 
intervals  to  obtain  nj/1  order  projected  error  responses.  The  second  order  system 
is  the  lowest  order  system  of  this  class  that  describes  the  mean  tracking  behav¬ 
ior  in  a  given  antiaircraft  artillery  man-machine  tracking  system.  Further,  the 
second  order  system  is  a  most  plausible  system  consistent  with  limitations  of  the 
human  controller  and  the  manner  the  subjects  were  trained. 


A  CLASS  OF  SL'QULNTIAL  INPUT  ADAPT  I VF  SYSTEMS 
INTRODUCTION 

The  sequential  input  adaptive  system  theory  introduced  in  a  previous 
publication  (2)  is  generalized  to  n*-h  order  systems  in  this  paper.  A  com¬ 
parative  study  is  made  of  the  first,  second,  and  third  order  systems. 

In  the  new  theory  it  is  assumed  that  a  living  controller,  through  condi¬ 
tioning,  accommodates  to  the  input  and  the  controlled  plant  so  that  the  total 
system  has  basic  mathematical  properties.  In  this  controller-centered  theory, 
predictions  are  made  instantaneously  and  tracking  movements  are  governed  by 
the  strategy. 

The  sequential  theory  describes  and  predicts  manual  control  tracking 
behavior  in  a  complex  antiaircraft  artillery  (AAA)  man-machine  system  (2). 
For  this  system,  the  sequential  theory  gives  a  description  of  mean  tracking 
behavior  that  has  a  closer  correlation  with  the  experimental  data  than  does 
the  description  given  by  the  optimal  control  approach  of  Kleinman  et  al .  (4). 
Furthermore,  the  sequential  theory  applies  to  the  human  eye  tracking  system 
(3). 

In  this  paper  the  basic  optimal  process  is  first  presented.  This  process 
is  then  sequentially  applied  to  represent  first,  second,  and  third  order  input 
adaptive  systems.  Finally,  the  theoretical  tracking  descriptions  are  compared 
with  tracking  data  from  an  AAA  man-machine  system. 

THE  DASIC  OPTIMAL  PROCESS 

The  basic  optimal  process  is  defined  by  an  nth  order  differential  equa¬ 
tion  in  projected  error  with  parameters  determined  such  that  a  cost  functional 
is  minimized.  Properties  of  the  basic  optimal  process  are  presented  for 
first,  second,  and  third  order  systems. 


The  input  adaptive  system  is  represented  in  Figure  1. 


The  internal  system  C-?  is  the  controller-plant.  It  is  assumed  that  in  the 
nt'1  order  system  the  controller 

1.  estimates  the  system  error  state  at  discrete  times  ti  (tg  <  t^  < 
•••  <  tm)  of  the  tracking  interval 

e(t i )  s  i(t*)  -  m(tT )  (1) 

e(rt-l)  (t-j )  =  i  (n-1)  (t"J)  -  m(n-D(t:), 

2.  predicts  the  input  at  each  t-j  by  n  terms  of  a  Taylor  series  repre¬ 
sentation  of  the  input,  and 

3.  effects  systematic  open-loop  control  over  the  intervals  (t-j,  tj  +  j) 
to  reduce  the  error  relative  to  the  predicted  input. 

There  is  no  time  delay  in  the  prediction-control  process.  The  input  is 
assumed  to  be  piecewise  n-1  times  differentiable  and  such  that  the  one-sided 
limits  in  equation  1  exist. 
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The  prediction-control  process  is  represented  by  the  repeated  application 


of  a  basic  optimal  process.  In  the  basic  optimal  process,  the  system  input 
i{t)  is  predicted  at  time  t,  by 

*  n-1  i ' J ) ( t* ) 

i(t)  =  l  -  — —  (t  -  ti)J  t  >  ti  (2) 

j=0  J! 

and  an  error  response  to  this  predicted  input,  e(t)  s  i(t)  -  m(t)  where  m(t) 
is  the  system  output,  is  determined  by 

n 

e(n)(t)  +  l  aje("-j)(t)  =  0  t  >  ti  (3) 

j=l 

e(3)  (tj )  =  i(J)  (t|)  -  m(j)(tp  0  _<  j  _<  n-1 
where  ( a j)  are  constants  that  minimize  the  associated  cost  functional 

Jn  =  /“  (e(n)(t))2  +  f  ( fije("-j)(t)  )2  dt  (4) 

ti  (_  j=l  _ 

for  given  nonnegative  constants  (6j)  with  $n  >  0.  The  constants  (Uj) 
are  denoted  the  strategy. 

Justification  for  the  forms  in  equations  3  and  4  follows  from  that  given 
in  reference  2.  The  basic  operation  in  defining  the  variational  problem  is 
the  extension  of  the  upper  limit  in  the  cost  functional  and  the  continuation 
of  the  projected  error  through  all  future  time. 


In  the  basic  optimal  process  for  n  =  1,  2,  and  3,  the  parameters  (aj) 
are  uniquely  determined  by  the  strategy  (3j).  Cost  functional  Jj  has  a 
unique  minimum  when 

a]  =  3} .  (5) 


Cost  functional  J2  has  a  unique  minimum  when 

al=  ( 3j2  +  2  02 )  ^ 
a2  =  32 • 


(6) 

(7) 


Cost  functional  J3  has  a  unique  minimum  when 


=  (p+A+B)l/2  +  (2p  -  (A+3)  +  2  jTp  -  ~  (A+B))2  +  |  (A-B)2  l/2  }1/2  (3) 


02 


=  (p+A+B)l/2  +  {2p  -  (A+B)  +  2  jTp  -  i  (A+B))2  +  2  (A-B)2 


a3  =  ^3 


1/2  }l/2  (0) 

(10) 


where 


A  = 


.  b  + 

'b?  ,  a3)  1/2 

2 

4  2/j 

1/3 


A 


b  !b£  +  a3!l/2~|l/3 

2  "  i  4  +  27J 


P  = 


l 

3 


*12 


a  ■  i  [stf  -  6l4] 
b  =  A-  (  -20i6  +  93i2 322 


b  =  -L  ^-2&z6  +  90!2622332  - 


The  roots  of  complex  numbers  z  =  rei e  in  equations  8  and  0  are  taken 


zl/n  =  rl/n  cos  +  i  Sin  |^j~j 


Critical  points  for  J3,  J2,  and  J3  may  be  obtained  by  direct  com¬ 
putation  (evaluation  and  differentiation  of  the  cost  functional)  or  by  other 
variational  methods  (1).  The  cost  functionals  may  bo  shown  to  have  mininums 
at  the  critical  points  defined  by  equations  5-10  through  a  consideration  of 
quadratic  forms  (see  reference  5). 

Cost  functionals  Jj,  J2,  and  J3,  evaluated  for  unit  step  inputs 
applied  at  t  =  0  with  zero  initial  conditions  on  the  system  output,  are  given 
for  reference  in  the  Appendix. 

The  strategy  parameters  (Bj)  have  physical  meaning:  they  indicate  the 
importance  the  controller  gives  to  each  quantity  in  equation  4.  The  manner  in 
which  the  strategy  affects  the  system  response  is  clearly  illustrated  in  the 
second  order  system  when  the  input  is  a  step  function.  For  this  input,  the 
system  output  response  is  overdamped  when  »  $2  (so  that  » 

263)  and  is  underdamped  when  63  >>  &1  (so  that  <<  Z&2)  • 

Two  additional  properties  of  the  variational  problems  are  given.  First, 
any  solution  to  equation  3  generated  by  the  variational  process  tends  to  zero 
as  t  becomes  large.  This  follows  from  the  existence  of  the  cost  functional 
(equation  4).  Second,  the  relationships  that  minimize  Jn  (n  =  2  or  3)  also 
minimize  Jn_ 3 ;  for  if  en  is  set  equal  to  zero  in  these  relationships,  then 
the  parameters  (a-j)  that  minimize  Jn_i  are  obtained.  (For  n  =  3,  this  is 
most  easily  shown  using  the  necessary  conditions  for  J3  to  have  a  minimum  as 
given  in  the  Appendix.) 

In  the  basic  optimal  process  the  input  is  predicted  by  n  terms  of  a 
Taylor  series  representation  of  the  input.  An  error  response  to  the  predicted 
input  is  determined  by  the  strategy  and  the  initial  conditions  through  an  nth 
order  differential  equation. 
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TIT.  ADAPT  I  VC  PROGRAM 


The  basic  optimal  process  is  sequentially  applied  in  the  tracking 
algorithm  called  the  adaptive  program.  In  option  1)  of  the  adaptive  program 
the  basic  optimal  process  is  applied  at  constant  increments  of  time  £tc.  In 
option  2)  of  the  adaptive  program  the  basic  optimal  process  is  applied  when 

the  absolute  value  of  the  system  error  exceeds  the  system  error  threshold 

i; j ,  but  is  applied  such  that  t-j  +  j  -  ti  >.  T$  where  T$  is  the  minimum 

period  for  a  sequential  problem.  (The  criteria  in  option  2)  can  be  gener¬ 
alized  to  include  threshold  conditions  on  derivatives  of  the  system  error.) 
The  adaptive  program  predicts  the  input  over  successive  time  intervals  by  a 
sequence  of  steps,  ramps,  or  parabolas  (for  n  =  1,  2,  or  3,  respectively)  and 
produces  n^  order  error  responses  (dependent  upon  the  strategy)  to  the 
components  of  the  predicted  input.  The  system  output  and  the  system  error  are 

a  ~ 

defined  over  each  subinterval  ( t -j ,  t-j+|)  by  m  =  i  -  e  and  e  =  i  -  m, 
respectively. 

CONTINUOUS  MODELS 

Suppose  that  the  input  i(t)  is  n  times  differentiable  for  t  >  tg  and 

the  strategy  is  constant.  If  the  time  intervals  between  successive  applica¬ 
tions  of  the  basic  optimal  process  are  small,  then  the  sequence  of  differen¬ 
tial  equations  3,  solved  in  the  adaptive  program,  is  approximated  by 

c(n)(t)  +  aje(n-j)(t)  =  i (n) (t)  t  >  t0  (11) 

e(t0)  =  i  (to)  -  m(t0) 


G(n-l)(t0)  =  i  (n-1)  (tn)  -  m(n-D(t0). 


This  result  uses  the  identity  e  =  i  -  i  +  e.  The  initial  value  problem  (11) 
is  an  approximate  continuous  representation  for  the  sequential  theory. 


Associated  with  equation  11  is  a  feedback  control  system  with  unity  food- 

n 

back  and  open-loop  transfer  function  )  a;s-J.  This  feedback  control  system 

j=l  J 

is  another  continuous  model. 

liquations  6-10  qualitatively  describe  how  the  strategy  (3-j)  regulates 
the  parameters  (a-j)  in  these  models. 

The  transition  from  a  higher  order  system  to  a  lower  order  system  is 
examined  for  the  special  case  where  the  input  is  n  times  differentiable  for 
t  >  tf).  Consider  the  system  (equation  11)  or  the  associated  feedback  con¬ 
trol  system  and  n  -=  ,?  or  3.  Let  (aj)  be  formally  defined  in  terms  of  (f?j) 
by  equations  6-10.  As  Bn  tends  to  zero,  the  steady-state  solution  to  the 


•.th 


order  system  approaches  the  steady  state  solution  to  the  n-lth  order 


system  with  the  same  input.  (This  is  most  easily  seen  using  Laplace  trans¬ 
forms.)  Therefore,  there  is  a  regular  transition  in  the  steady-state  solution 
through  the  strategy  from  a  higher  order  system  to  a  lower  order  system  when 
the  input  is  properly  differentiable. 


ANTIAIRCRAFT  ARTlLLfPY  flAN-MACIIINF.  TRACKIN'.  SY STT?! 

The  sequential  theory  is  applied  to  manual  control  tracking  in  an  AAA 
system.  The  theoretical  tracking  descriptions  provided  by  the  first,  second, 
and  third  order  input  adaptive  systems  are  compared  with  the  experimental 
data. 

The  tracking  experiment  is  described  in  a  previous  publication  (2).  Two 
well-trained  operators  manually  tracked  targets  en  a  simulated  AAA  system. 


•i.Si 


One  operator  controlled  the  system  in  azimuth  and  the  other  operator  con¬ 
trolled  the  system  in  elevation. 

In  the  present  comparative  study,  only  the  Trajectory  I  tracking  task  is 
considered  and  only  option  1)  of  the  adaptive  program  is  used.  The  azimuth 
and  elevation  components  of  Trajectory  I  are  given  in  Figure  2.  Time  his¬ 
tories  of  ensemble  averages  (15-13  runs)  of  the  experimental  azimuth  and  ele¬ 
vation  tracking  errors  are  given  in  Figure  3. 

In  the  analysis  it  is  assumed  that  the  strategy  of  each  operator  is 
constant  throughout  the  tracking  task.  The  adaptive  program  is  applied  sepa¬ 
rately  to  each  azimuth  and  elevation  tracking  task.  For  convenience,  the 
initial  conditions  used  in  the  adaptive  program  are  e(n)  =  ...  =  e  (n_^(0)  = 

n. 

The  parameters  used  in  the  adaptive  program  for  the  second  order  system 
are  those  which  were  previously  identified  from  the  AAA  tracking  data  (2). 
For  the  purpose  of  comparison,  the  6n  component  of  the  strategy  is  held 
fixed  for  the  first,  second,  and  third  order  systems.  The  parameters  used  in 
the  adaptive  program  for  each  n^*1  order  system  are 

(  1  1  <  j  <  n 

*i  =  ' 

10  j  -  n 

and  &tc  =  .1  s.  For  each  system  the  strategy  is  primarily  to  minimize  the 
projected  error. 

The  adaptive  program  system  tracking  errors  on  the  azimuth  and  elevation 
components  of  Trajectory  I  are  given  in  Figure  4  for  the  first,  second,  and 
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Figure  2.  Trajectory 


components:  (a)  azimuth,  (b)  elevation. 


Figure  3.  Experimental  mean  tracking  errors  on  the  azimuth  and  elevation  i 
ponents  of  Trajectory  !:  (a)  azimuth,  (b)  elevation. 
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Figure  4.  Adaptive  program  option  1)  tracking  errors  on  the  azimuth  and  ele¬ 
vation  components  of  Trajectory  I:  (a)  first  order  system,  (h) 
second  order  system,  (c)  third  order  system. 
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third  order  systems.  The  option  1)  tracking  errors  for  the  given  strategics 
become  smaller  as  n  increases.  This  reduction  in  tracking  error  is  consistent 
with  the  improved  predictions  of  the  input  (equation  ?.)  as  n  increases.  The 
nth  order  system  tracking  errors  are  proportional  to  the  n^h  derivatives 
of  the  input.  The  second  order  system  tracking  errors  are  characteristic  of 
the  experimental  data.  As  is  shown  in  reference  ?.,  the  option  1)  second  order 
system  tracking  errors  on  all  trajectories  have  a  closer  correlation  with  the 
experimental  data  than  those  of  the  optimal  control  approach  (4). 

The  first  order  system  with  its  single  strategy  parameter  does  not 
represent  the  tracking  behavior  in  the  AAA  system.  First,  the  first  order 
system  tracking  errors  considerably  differ  in  amplitude  and  profile  from  the 
experimental  tracking  errors.  Second,  the  identified  parameter  Bp  i n  T.he 
second  order  system  is  such  that  Bp  =  ap  >>  0  and  therefore  the  tracking 
response  is  characteristic  of  at  least  a  second  order  system. 

Properties  of  the  continuous  model  (equation  11)  are  used  to  classify  the 
AAA  tracking  response.  Although  the  tracking  responses  in  Figure  4  were 
computed  as  sequences  of  transient  responses,  they  essentially  represent 
steady-state  solutions  to  equation  11.  (When  the  exact  initial  conditions  are 
used  or  when  the  input  is  discontinuous,  the  transient  response  nay  dominate 
the  steady-state  response  (?).)  As  noted  earlier,  there  is  a  regular  transi¬ 
tion  in  the  steady-state  solution  through  the  strategy  from  a  higher  order 
systein  to  a  lower  order  system.  Therefore,  a  third  order  system  response 
corresponding  to  strategy  (1,  10,  e)  where  c  is  positive  and  sufficiently 
small  approximates  the  second  order  system  response  corresponding  to  strategy 
(1,  10)  (provided  i(t)  is  properly  differentiable).  Tins  demonstrates  that  a 
third  order  system  can  also  represent  the  tracking  behavior  in  the  AAA  system. 


further  i nf on:ut t  i on  i  j  known  about  the  AAA  system.  The  subjects  were 
trained  to  minimize  mean-square  tracking  error  (2).  This  suggests  that  the 
3n  component  of  the  strategy  should  be  large.  Thus,  a  third  order  system 
with  strategy  (1,  10,  e)  and  e  positive  and  small  is  not  appropriate.  It  is 
further  noted  that  a  third  order  system  with  small  B3  strategy  component 
would  be  ineffective  in  reducing  the  tracking  error  associated  with  the 
sudden,  initial  appearance  of  the  target.  In  addition,  third  order  system 
descriptions  with  33  >>  3i  and  33  >>  32,  as  illustrated  in  Figure  4, 
are  not  characteristic  of  the  tracking  data. 

The  second  order  system  is  the  lowest  order  system  of  this  class  that 
describes  the  mean  tracking  behavior  in  the  AAA  system.  The  second  order 
system  description  with  strategy  $2  >>  3i  is  consistent  with  the  manner 
the  subjects  were  trained. 


DISCUSSION 

A  mathematical  theory  was  presented  for  first,  second,  and  third  order 
sequential  input  adaptive  systems.  In  these  systems,  a  theoretical  controller 
predicts  the  input  at  instants  by  n  terms  of  a  Taylor  series  representation  of 
the  input  and  effects  open-loop  control  over  intervals  to  obtain  nth  order 
projected  error  responses. 

The  second  order  system  is  the  lowest  order  system  of  this  class  that 
produces  a  description  characteristic  of  the  mean  tracking  behavior  in  the  AAA 
man-machine  system.  Higher  order  system  descriptions  may  not  be  appropriate 
in  this  application.  In  a  third  order  system,  for  example,  the  controller 
would  have  to  regularly  infer  the  target  acceleration  from  the  visual  display 
and  control  using  this  information,  stressing  or  exceeding  human  capabili¬ 
ties.  Thi^d  order  system  descriptions  with  small  33  strategy  component  are 
not  appropriate  because  the  subjects  were  trained  to  minimize  mean-square 


13 


tracking  error.  Therefore,  the  second  order  system  is  the  most  plausible 
systen  consistent  with  limitations  of  the  human  controller  and  the  manner  the 
subjects  wore  trained. 

A  distinctive  feature  of  the  now  tiieory  is  that  it  represents  the  overall 
system  tracking  response  by  a  sequence  of  transient  responses.  The  sequential 
theory  provides  a  broad  nonlinear  description  for  tracking  systems  with  living 
control lers. 
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APPENDIX 


Iff 


Cost  functionals  J|,  >)2»  and  J3,  evaluated  for  unit  step  inputs 

applied  at  t  =  0  with  zero  initial  conditions  on  the  system  output,  are 


J1  = 


1 

2  a. 


J2  = 


J3 


2a^  «2 


2  2 
°1  +  31  ' 


3  A  .  2  2 

a2  +  a2  + 
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2a3^ala2"a3^ 


3  2  3 

a3  a2  +  ”3  + 


2  2  2  f  2  2  3 
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Necessary  conditions  for  J3  to  have  a  minimum  are 


a3  "  33 


with  a}  and  03  such  that 
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(  a  2  2] 

a2  |/l  “  al  J 


2  2 


?  3 


+  2-xjB.j  +  e>2  =  n 


+  2a233  +  e3ei"  =  0  . 


